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Bayesian Interval Estimation 


9.1.9 Bayesian Interval Estimation 

Interval estimation has a very natural interpretation in Bayesian inference. Suppose that we 
would like to estimate the value of an unobserved random variable X, given that we have 
observed Y = y. After calculating the posterior density fx\Y ( t | i /), wc can simply find an 
interval [a, b] for which we have 

P{a < X < b\Y = y) = 1 - ct. 

Such an interval is said to be a (1 — Cr) 100% credible interval for X. 

Bayesian Credible Intervals 

Given the observation Y = y, the interval [a, b] is said to be a (1 — Cr) 100% credible 
interval for X , if the posterior probability of X being in [a, b] is equal to 1 — OL. In other 
words, 


P(a < X < b\Y = y) = 1 - ct. 


Example 9.13 

Let X and Y be jointly normal and X ~ iV(0, 1), Y ~ 7V(1,4), and p(X, Y) = 
Find a 95% credible interval for X, given Y = 2 is observed. 

• Solution 

o As we have seen before, if X and Y are jointly nonnal random variables with 
parameters fix • pY - O'y, and p. then, given Y = y, X is normally 
distributed with 


E[X\Y = y] = ltx + pax -——, 

a Y 

Var(X|y = y) = (1 - p 2 )v\. 

Therefore, X\Y = 2 is nonnal with 

r , n 1 2-1 1 

E[X\Y = y] = 0 + -- — = -, 

Var(X |Y = y)= (l - 1) • 1 = |. 
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Here Ol = 0.05, so we need an interval [a, b] for which 

P(a < X < b\Y = 2) = 0.95 

We usually choose a symmetric interval around the expected value 
E[X\Y = y\ = -j. That is, we choose the interval in the fonn of 


1 1 

4~ C ’4 +C 


Thus, we need to have 


/1 1 

P -~c<X< - + c\Y = 2 
V 4 4 
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r. 


V\/374 

1 = 0.95 


Solving for C, we obtain 


c = 0.975) « 1.70 


Therefore, the 95% credible interval for is 


7 _ c,-+c 

4 4 


-1.45,1.95]. 
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